Symbol-based variable node updates for binary LDPC codes

ABSTRACT

Systems and methods for implementing data protection techniques with symbol-based variable node updates for binary low-density parity-check (LDPC) codes are described. A semiconductor memory (e.g., a NAND flash memory) may read a set of data from a set of memory cells, determine a set of data state probabilities for the set of data based on sensed threshold voltages for the set of memory cells, generate a valid codeword for the set of data using an iterative LDPC decoding with symbol-based variable node updates and the set of data state probabilities, and store the valid codeword within the semiconductor memory or transfer the valid codeword from the semiconductor memory. The iterative LDPC decoding may utilize a message passing algorithm in which outgoing messages from a plurality of multi-variable nodes are generated using incoming messages (e.g., log-likelihood ratios or L-values) from a plurality of check nodes.

CLAIM OF PRIORITY

The present application is a continuation of U.S. patent applicationSer. No. 16/205,099, entitled “Symbol-Based Variable Node Updates forBinary LDPC Codes,” filed Nov. 29, 2018, published as US 2020/0174881 onJun. 4, 2020 and issued as U.S. Pat. No. 11,231,993 on Jan. 25, 2022,which is herein incorporated by reference in its entirety.

BACKGROUND

Semiconductor memory is widely used in various electronic devices suchas mobile computing devices, mobile phones, solid-state drives, digitalcameras, personal digital assistants, medical electronics, servers, andnon-mobile computing devices. Semiconductor memory may comprisenon-volatile memory or volatile memory. A non-volatile memory deviceallows information to be stored or retained even when the non-volatilememory device is not connected to a source of power (e.g., a battery).Examples of non-volatile memory include flash memory (e.g., NAND-typeand NOR-type flash memory), Electrically Erasable Programmable Read-OnlyMemory (EEPROM), ferroelectric memory (e.g., FeRAM), magnetoresistivememory (e.g., MRAM), and phase change memory (e.g., PCM). In recentyears, both volatile and non-volatile memory devices have been scaled inorder to reduce the cost per bit. However, as process geometries shrink,many design and process challenges are presented. These challengesinclude increased variability in memory cell I-V characteristics overprocess, voltage, and temperature variations and increasedsusceptibility to chip-level and system-level soft errors. Moreover,storing more than one data bit per memory cell (e.g., a multi-level ormulti-state memory cell) may enhance data storage density at the expenseof increased data errors.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of one embodiment of a memory system connectedto a host.

FIG. 2 is a block diagram of one embodiment of a Front End ProcessorCircuit. In some embodiments, the Front End Processor Circuit is part ofa Controller.

FIG. 3 is a block diagram of one embodiment of a Back End ProcessorCircuit. In some embodiments, the Back End Processor Circuit is part ofa Controller.

FIG. 4 is a block diagram of one embodiment of a memory package.

FIG. 5A is a block diagram of one embodiment of a memory die.

FIG. 5B depicts one embodiment of a read/write circuit.

FIG. 6A depicts one embodiment of a Tanner graph.

FIGS. 6B-6D depict embodiments of portions of a Tanner graph.

FIGS. 6E-6G depicts embodiments of a multi-variable node that isassociated with multiple variable nodes.

FIG. 7A is a flowchart describing one embodiment of a process forcorrecting data errors.

FIG. 7B is a flowchart describing another embodiment of a process forcorrecting data errors.

DETAILED DESCRIPTION

Technology is described for implementing data protection techniques thatprotect data stored in semiconductor memory devices from datatransmission and storage errors. The data errors may comprise random biterrors that are caused by alpha particles emitted from chip packagingmaterials or caused from various on-chip or off-chip noise sources, suchas inductive or capacitive crosstalk from neighboring signal lines. Insome cases, a semiconductor memory (e.g., a NAND flash memory or a phasechange memory) may read a set of data from a set of memory cells,determine a set of data state probabilities for the set of data (e.g.,based on the sensed threshold voltages for the set of memory cells),generate a valid codeword for the set of data using an iterativelow-density parity-check (LDPC) decoding with symbol-based variable nodeupdates and the set of data state probabilities, and then output (e.g.,store or transfer) the valid codeword. In some cases, the probabilitythat a memory cell stores a particular data state may be reduced (e.g.,cut in half) if a sensed threshold voltage for the memory cell is closeto the edge of a threshold voltage window (e.g., within 50 mV from theedges of the threshold voltage window for the B-state). The iterativeLDPC decoding may utilize a message passing algorithm in which outgoingmessages from a plurality of variable nodes (e.g., each comprisingmulti-variable nodes) are generated using incoming messages (e.g.,log-likelihood ratios or L-values) from a plurality of check nodes. Theset of data state probabilities may correspond with the probabilities ofmulti-level memory cell values (e.g., of two-bits per cell or three-bitsper cell values). Multi-level cell memories may provide a non-binarychannel as each memory cell may store more than two data states. Oneissue with non-binary LDPC codes is that although they maintainsimplicity at the variable nodes, they are computationally heavy at thecheck nodes. One benefit of using symbol-based variable node updates forbinary LDPC codes and adding computational complexity to the variablenodes by combining or grouping variable nodes into multi-variable nodesthat take into account symbol likelihoods is that decoding performancemay be increased.

Low-density parity-check (LDPC) codes are a class of linear block codeswhich may provide near-capacity performance with hardware implementabledecoders. LDPC codes may comprise binary LDPC codes or non-binary LDPCcodes that are capable of correcting symbol-based errors. A non-binarysymbol may represent a grouping of two or more bits. LDPC codes may berepresented using a Tanner graph (or a bipartite graph) in whichvariable nodes (VNs) correspond with the bits of a codeword (e.g., thedata and parity bits that are stored within a non-volatile memory and/ortransmitted from the non-volatile memory) and check nodes (CNs)correspond with a set of parity-check constraints that define the code.Each variable node may correspond with a code symbol of the codeword(e.g., each variable node may correspond with an individual bit out of aplurality of bits for the codeword) and each check node may correspondwith one parity-check equation. The number of variable nodes maycomprise the total number of input bits for the codeword. An edge of theTanner graph connects a variable node to a check node and may correspondwith a “1” in a parity-check matrix for the LDPC code. A check node isadjacent to and shares edges with all variable nodes whose correspondingcodeword symbols appear in the parity check associated with the checknode.

LDPC codes may be iteratively decoded using a message passing algorithm(e.g., iterative belief propagation decoding), in which messages arepassed through the edges of the Tanner graph between check nodes andvariable nodes. The message passing algorithm may comprise a sum-productdecoding algorithm or max-product decoding algorithm. The variable nodesand check nodes may perform local decoding operations and exchangemessages along the edges of the Tanner graph until either a validcodeword is identified or an iteration limit is reached (e.g., more thanten iterations have been performed). The messages may comprise softvalues or likelihood information, such as the probability that a givenbit in a codeword is a “1,” a likelihood ratio of the probability thatthe given bit is a zero divided by the probability that the given bit isa one, or the logarithm of the likelihood ratio (e.g., the natural logof the likelihood ratio). The log-likelihood ratio may be referred to asan L-value. The L-value may correspond with the probability that a givenbit or data state is a “0” or a “1.” In one example, if the L-value isgreater than 0, then the probability that the bit or data state is a “0”is greater than the probability that the bit or data state is a “1.”

During a first iteration of a message passing algorithm, the incomingmessages received from the channel at the variable nodes (e.g., theinput codeword) are directly passed along their edges to theirneighboring check nodes because there are no incoming messages from thecheck nodes during the first iteration. The check nodes then performlocal decoding operations and compute outgoing messages that arefunctions of the incoming messages received from the neighboringvariable nodes. Subsequently, these outgoing messages are sent back tothe neighboring variable nodes. A complete iteration involves messagesbeing passed back and forth between the variable nodes and the checknodes once. After each iteration, a determination may be made as towhether a valid codeword has been generated. If a valid codeword hasbeen generated, then the codeword may be outputted and the iterativeprocess may be terminated. The valid codeword comprising data and paritybits may be stored within a memory array of a semiconductor memory.

The semiconductor memory may comprise a non-volatile memory, such as aNAND Flash memory, or a volatile memory, such as a DRAM memory. Thesemiconductor memory may include a memory array that includes aplurality of NAND strings. In some embodiments, a memory array maycomprise a cross-point memory array. A cross-point memory array mayrefer to a memory array in which two-terminal memory cells are placed atthe intersections of a first set of control lines (e.g., word lines)arranged in a first direction and a second set of control lines (e.g.,bit lines) arranged in a second direction perpendicular to the firstdirection. The two-terminal memory cells may include aresistance-switching material, such as a phase change material, aferroelectric material, or a metal oxide (e.g., nickel oxide or hafniumoxide). In some cases, each memory cell in a cross-point memory arraymay be placed in series with a steering element or an isolation element,such as a diode, in order to reduce leakage currents. In cross-pointmemory arrays where the memory cells do not include an isolationelement, controlling and minimizing leakage currents may be asignificant issue, especially since leakage currents may vary greatlyover biasing voltage and temperature.

In one embodiment, a non-volatile storage system may include one or moretwo-dimensional arrays of non-volatile memory cells. The memory cellswithin a two-dimensional memory array may form a single layer of memorycells and may be selected via control lines (e.g., word lines and bitlines) in the X and Y directions. In another embodiment, a non-volatilestorage system may include one or more monolithic three-dimensionalmemory arrays in which two or more layers of memory cells may be formedabove a single substrate without any intervening substrates. In somecases, a three-dimensional memory array may include one or more verticalcolumns of memory cells located above and orthogonal to a substrate. Inone example, a non-volatile storage system may include a memory arraywith vertical bit lines or bit lines that are arranged orthogonal to asemiconductor substrate. The substrate may comprise a silicon substrate.The memory array may include rewriteable non-volatile memory cells,wherein each memory cell includes a reversible resistance-switchingelement without an isolation element in series with the reversibleresistance-switching element (e.g., no diode in series with thereversible resistance-switching element).

A non-volatile storage system may include a memory array incommunication with a memory controller for controlling the operation ofthe memory array and/or for controlling the reading of data from thememory array and the writing of data to the memory array. The memorycontroller may comprise an on-chip controller or an off-chip controller.The one or more state machines, page registers, SRAM, and controlcircuitry within the memory controller for controlling the operation ofthe memory array may be referred to as managing or control circuits. Themanaging or control circuits may facilitate one or more memory arrayoperations including forming, erasing, programming, or readingoperations. In one example, the one or more managing or control circuitsmay include any one of or a combination of control circuitry, statemachines, decoders, sense amplifiers, read/write circuits, and/orcontrollers. The managing or control circuits may also include errorcorrecting circuits and decoder circuits, such as an LDPC decodingcircuit, for detecting and correcting bit errors within data storedwithin the memory array. The managing or control circuits may cause datato be read from the memory array, detect a bit error within the data,and correct the bit error. The data to be written to the memory arraymay be buffered by the memory controller and error correcting code (ECC)data may be generated corresponding with the data to be written. The ECCdata, which allows data errors that occur during transmission or storageto be detected and/or corrected, may be written to the memory array orstored in non-volatile memory within memory controller.

FIG. 1 is a block diagram of one embodiment of a memory system 100connected to a host 120. Memory system 100 can implement the technologyproposed herein. Many different types of memory systems can be used withthe technology proposed herein. One example memory system is a solidstate drive (“SSD”); however, other types of memory systems can also beused. Memory system 100 comprises a Controller 102, non-volatile memory104 for storing data, and local memory (e.g. DRAM/ReRAM) 106. Controller102 comprises a Front End Processor Circuit (FEP) 110 and one or moreBack End Processor Circuits (BEP) 112. In one embodiment FEP 110 circuitis implemented on an ASIC. In one embodiment, each BEP circuit 112 isimplemented on a separate ASIC. The ASICs for each of the BEP circuits112 and the FEP circuit 110 are implemented on the same semiconductorsuch that the Controller 102 is manufactured as a System on a Chip(“SoC”). FEP 110 and BEP 112 both include their own processors. In oneembodiment, FEP 110 and BEP 112 work as a master slave configurationwhere the FEP 110 is the master and each BEP 112 is a slave. Forexample, FEP circuit 110 implements a flash translation layer thatperforms memory management (e.g., garbage collection, wear leveling,etc.), logical to physical address translation, communication with thehost, management of DRAM (local volatile memory) and management of theoverall operation of the SSD (or other non-volatile storage system). TheBEP circuit 112 manages memory operations in the memory packages/die atthe request of FEP circuit 110. For example, the BEP circuit 112 cancarry out the read, erase and programming processes. Additionally, theBEP circuit 112 can perform buffer management, set specific voltagelevels required by the FEP circuit 110, perform error correction (ECC),control the Toggle Mode interfaces to the memory packages, etc. In oneembodiment, each BEP circuit 112 is responsible for its own set ofmemory packages. Controller 102 is one example of a control circuit.

In one embodiment, non-volatile memory 104 comprises a plurality ofmemory packages. Each memory package includes one or more memory die.Therefore, Controller 102 is connected to one or more non-volatilememory die. In one embodiment, each memory die in the memory packages104 utilize NAND flash memory (including two dimensional NAND flashmemory and/or three dimensional NAND flash memory). In otherembodiments, the memory package can include other types of memory.

Controller 102 communicates with host 120 via an interface 130 thatimplements NVM Express (NVMe) over PCI Express (PCIe). For working withmemory system 100, host 120 includes a host processor 122, host memory124, and a PCIe interface 126. Host memory 124 is the host's physicalmemory, and can be DRAM, SRAM, non-volatile memory or another type ofstorage. Host 120 is external to and separate from memory system 100. Inone embodiment, memory system 100 is embedded in host 120.

FIG. 2 is a block diagram of one embodiment of FEP circuit 110. FIG. 2shows a PCIe interface 150 to communicate with host 120 and a hostprocessor 152 in communication with that PCIe interface. The hostprocessor 152 can be any type of processor known in the art that issuitable for the implementation. Host processor 152 is in communicationwith a network-on-chip (NOC) 154. A NOC is a communication subsystem onan integrated circuit, typically between cores in an SoC. NOC's can spansynchronous and asynchronous clock domains or use unclocked asynchronouslogic. NOC technology applies networking theory and methods to on-chipcommunications and brings notable improvements over conventional bus andcrossbar interconnections. NOC improves the scalability of SoCs and thepower efficiency of complex SoCs compared to other designs. The wiresand the links of the NOC are shared by many signals. A high level ofparallelism is achieved because all links in the NOC can operatesimultaneously on different data packets. Therefore, as the complexityof integrated subsystems keep growing, a NOC provides enhancedperformance (such as throughput) and scalability in comparison withprevious communication architectures (e.g., dedicated point-to-pointsignal wires, shared buses, or segmented buses with bridges). Connectedto and in communication with NOC 154 is the memory processor 156, SRAM160 and a DRAM controller 162. The DRAM controller 162 is used tooperate and communicate with the DRAM (e.g., DRAM 106). SRAM 160 islocal RAM memory used by memory processor 156. Memory processor 156 isused to run the FEP circuit and perform the various memory operations.Also in communication with the NOC are two PCIe Interfaces 164 and 166.In the embodiment of FIG. 2 , the SSD controller will include two BEPcircuits 112; therefore there are two PCIe Interfaces 164/166. Each PCIeInterface communicates with one of the BEP circuits 112. In otherembodiments, there can be more or less than two BEP circuits 112;therefore, there can be more than two PCIe Interfaces.

FIG. 3 is a block diagram of one embodiment of the BEP circuit 112. FIG.3 shows a PCIe Interface 200 for communicating with the FEP circuit 110(e.g., communicating with one of PCIe Interfaces 164 and 166 of FIG. 2). PCIe Interface 200 is in communication with two NOCs 202 and 204. Inone embodiment the two NOCs can be combined to one large NOC. Each NOC(202/204) is connected to SRAM (230/260), a buffer (232/262), processor(220/250), and a data path controller (222/252) via an XOR engine(224/254) and an ECC engine (226/256). The ECC engines 226/256 are usedto perform error correction, as known in the art. The XOR engines224/254 are used to XOR the data so that data can be combined and storedin a manner that can be recovered in case there is a programming error.Data path controller 222 is connected to a memory interface 228 forcommunicating via four channels with memory packages. Thus, the top NOC202 is associated with memory interface 228 for four channels forcommunicating with memory packages and the bottom NOC 204 is associatedwith memory interface 258 for four additional channels for communicatingwith memory packages. In one embodiment, each memory interface 228/258includes four Toggle Mode interfaces (TM Interface), four buffers andfour schedulers. There is one scheduler, buffer and TM Interface foreach of the channels. The processor can be any standard processor knownin the art. The data path controllers 222/252 can be a processor, FPGA,microprocessor or other type of controller. The XOR engines 224/254 andECC engines 226/256 are dedicated hardware circuits, known as hardwareaccelerators. In other embodiments, the XOR engines 224/254 and ECCengines 226/256 can be implemented in software. The scheduler, buffer,and TM Interfaces are hardware circuits. In other embodiments, thememory interface (an electrical circuit for communicating with memorydie) can be a different structure than depicted in FIG. 3. Additionally,controller with structures different than FIGS. 2 and 3 can also be usedwith the technology described herein.

FIG. 4 is a block diagram of one embodiment of a memory package 104 thatincludes a plurality of memory die 300 connected to a set of memoryinterface signals 294. The memory interface signals 294 connects to aToggle Mode Interface 296 for communicating with the TM Interface of aBEP circuit 112 (see e.g., FIG. 3 ). In some embodiments, the memorypackage can include a small controller connected to the memory bus andthe TM Interface. The memory package can have one or more memory die. Inone embodiment, each memory package includes sixteen memory die;however, other numbers of memory die can also be implemented. Thetechnology described herein is not limited to any particular number ofmemory die. FIG. 4 shows that some memory systems comprise a pluralityof memory die 300 each having non-volatile memory cells that store dataand may be connected to a control circuit (e.g., controller 102 or othercontrol circuit, such as a microprocessor, state machine, FPGA, etc.).The controller (or other control circuit) is used to transfer data tothe memory die, program the data in the memory die, read the date fromthe memory die and transfer the data read from the memory die.

FIG. 5A is a functional block diagram of one embodiment of a memory die300. Each of the one or more memory die of FIG. 4 can be implemented asmemory die 300 of FIG. 5A. The components depicted in FIG. 5A areelectrical circuits. In one embodiment, each memory die 300 includes amemory structure 326, control circuitry 310, row decoder 324, columndecoder 332 and read/write circuits 328, all of which are electricalcircuits. Memory structure 326 is addressable by word lines via rowdecoder 324 and by bit lines via a column decoder 332. The read/writecircuits 328 include multiple sense blocks 350 including SB1, SB2, . . ., SBp (sensing circuitry) and allow a page (or multiple pages) of datain multiple memory cells to be read or programmed in parallel. In oneembodiment, each sense block includes a sense amplifier and a set oflatches connected to the bit line. The latches store data to be writtenand/or data that has been read. The sense blocks include bit linedrivers.

Commands and data are transferred in and out of the memory die 300 viamemory die interface 318, which connects to memory interface signals 294of a memory package 104 (see FIG. 4 ).

Examples of memory die interface 318 include a Toggle Mode Interface andan Open NAND Flash Interface (ONFI). Other I/O interfaces can also beused. Toggle mode (e.g., Toggle Mode 2.0 JEDEC Standard or Toggle Mode800) is an asynchronous memory interface that supports SDR and DDR witha DQS signal acting as a data strobe signal. Table 1 provides adefinition of one example of a Toggle Mode Interface that can be used toimplement memory die interface 318.

TABLE 1 Signal Name Type Function ALE Input Address Latch Enablecontrols the activating path for addresses to the internal addressregisters. Addresses are latched on the rising edge of WEn with ALEhigh. CEn Chip Enable controls memory die selection. CLE Input CommandLatch Enable controls the activating path for commands sent to thecommand register. When active high, commands are latched into thecommand register through the I/O ports on the rising edge of the WEnsignal. RE Input Read Enable Complement REn Input Read Enable controlsserial data out, and when active, drives the data onto the I/O bus. WEnInput Write Enable controls writes to the I/O port. Commands andaddresses are latched on the rising edge of the WEn pulse. WPn InputWrite Protect provides inadvertent program/erase protection during powertransitions. The internal high voltage generator is reset when the WPnpin is active low. DQS Input/Output Data Strobe acts as an output whenreading data, and as an input when writing data. DQS is edge-alignedwith data read; it is center-aligned with data written. DQSnInput/Output Data Strobe complement (used for DDR) Bus[0:7] Input/OutputData Input/Output (I/O) signal bus inputs commands, addresses, and data,and outputs data during Read operations. The I/O pins float to High-zwhen the chip is deselected or when outputs are disabled. R/Bn OutputReady/Busy indicates device operation status. R/Bn is an open-drainoutput and does not float to High-z when the chip is deselected or whenoutputs are disabled. When low, it indicates that a program, erase, orrandom read operation is in process; it goes high upon completion. ZQSupply Reference for ZQ calibration. VCC Supply Power supply for memorydie. VCCQ Supply I/O power for I/O signals VPP Supply Optional, highvoltage, external power supply VREF Supply Reference voltage, reservedfir Toggle Mode DDR2 VSS Supply Ground

In some example implementations, memory interface signals 294 of amemory package 104 (see FIG. 4 ) comprises the signals of Table 1;however, including multiple CEn signals (e.g., CEn0, CEn1, CEn2, . . .). In one embodiment, memory interface signals 294 includes four CEnsignals (e.g., CEn0, CEn1, CEn2, CEn3), the memory package 104 includessixteen memory die 300, and each of the CEn signals is connected to fourmemory die 300 of the same package. In these embodiments, the samesignal bus BUS[0:7] is connected to multiple memory die 300; therefore,the multiple CEn signals (e.g., CEn0, CEn1, CEn2, CEn3) and chipaddresses (see below) are used to select a subset of memory die for agiven operation.

Control circuitry 310 cooperates with the read/write circuits 328 toperform memory operations (e.g., write, read, erase, and others) onmemory structure 326. In one embodiment, control circuitry 310 includesa state machine 312, an on-chip address decoder 314, a power controlcircuit 316 and a temperature detection circuit 319. State machine 312provides die-level control of memory operations. In one embodiment,state machine 312 is programmable by software. In other embodiments,state machine 312 does not use software and is completely implemented inhardware (e.g., electrical circuits). In some embodiments, state machine312 can be replaced by a microcontroller or microprocessor. In oneembodiment, control circuitry 310 includes buffers such as registers,ROM fuses and other storage devices for storing default values such asbase voltages and other parameters.

The on-chip address decoder 314 provides an address interface betweenaddresses used by controller 120 to the hardware address used by thedecoders 324 and 332. Power control module 316 controls the power andvoltages supplied to the word lines and bit lines during memoryoperations. Power control module 316 may include charge pumps forcreating voltages.

For purposes of this document, control circuitry 310, alone or incombination with read/write circuits 328 and decoders 324/332, compriseone or more control circuits for memory structure 326. These one or morecontrol circuits are electrical circuits that perform the functionsdescribed below in the flow charts and signal diagrams. In otherembodiments, the one or more control circuits can consist only ofcontroller 102, which is an electrical circuit in combination withsoftware, that performs the functions described below in the flow chartsand signal diagrams. In another alternative, the one or more controlcircuits comprise controller 102 and control circuitry 310 performingthe functions described below in the flow charts and signal diagrams. Inanother embodiment, the one or more control circuits comprise statemachine 312 (or a microcontroller or microprocessor) alone or incombination with controller 102.

In one embodiment, memory structure 326 comprises a monolithic threedimensional memory array of non-volatile memory cells in which multiplememory levels are formed above a single substrate, such as a wafer. Thememory structure may comprise any type of non-volatile memory that ismonolithically formed in one or more physical levels of arrays of memorycells having an active area disposed above a silicon (or other type of)substrate. In one example, the non-volatile memory cells of memorystructure 326 comprise vertical NAND strings with charge-trappingmaterial. In another embodiment, memory structure 326 comprises a twodimensional memory array of non-volatile memory cells. In one example,the non-volatile memory cells are NAND flash memory cells utilizingfloating gates. Other types of memory cells (e.g., NOR-type flashmemory) can also be used.

The exact type of memory array architecture or memory cell included inmemory structure 326 is not limited to the examples above. Manydifferent types of memory array architectures or memory celltechnologies can be used to form memory structure 326. No particularnon-volatile memory technology is required for purposes of theembodiments proposed herein. Other examples of suitable technologies formemory cells of the memory structure 326 include ReRAM memories,magnetoresistive memory (e.g., MRAM, Spin Transfer Torque MRAM, SpinOrbit Torque MRAM), phase change memory (e.g., PCM), and the like.Examples of suitable technologies for architectures of memory structure126 include two dimensional arrays, three dimensional arrays,cross-point arrays, stacked two dimensional arrays, vertical bit linearrays, and the like.

FIG. 5B depicts one embodiment of a read/write circuit 502 along with aportion of a memory array 501. Read/write circuit 502 is one example ofan implementation of read/write circuit 328 in FIG. 5A. The portion of amemory array 501 includes two of the many bit lines (one selected bitline labeled “Selected BL” and one unselected bit line labeled“Unselected BL”) and two of the many word lines (one selected word linelabeled “Selected WL” and one unselected word line labeled “UnselectedWL”). The portion of a memory array also includes a selected memory cell550 and unselected memory cells 552-556. In one embodiment, the portionof a memory array 501 may comprise a memory array with bit linesarranged in a direction horizontal to the substrate. In anotherembodiment, the portion of a memory array 501 may comprise a memoryarray with bit lines arranged in a vertical direction that isperpendicular to the substrate.

As depicted, during a memory array operation (e.g., a read or sensingoperation), the selected bit line may be biased to 1V, the unselectedword line may be biased to 0.6V, the selected word line may be biased to0V, and the unselected bit line may be biased to 0.5V. In someembodiments, during a second memory array operation, the selected bitline may be biased to a selected bit line voltage (e.g., 2.0V), theunselected word line may be biased to an unselected word line voltage(e.g., 1.0V), the selected word line may be biased to a selected wordline voltage (e.g., 0V), and the unselected bit line may be biased to anunselected bit line voltage (e.g., 1V). In this case, the unselectedmemory cells sharing the selected word line will be biased to thevoltage difference between the selected word line voltage and theunselected bit line voltage. In other embodiments, the memory arraybiasing scheme depicted in FIG. 5B may be reversed such that theselected bit line is biased to 0V, the unselected word line is biased to0.4V, the selected word line is biased to 1V, and the unselected bitline is biased to 0.5V.

As depicted in FIG. 5B, the SELB node of read/write circuit 502 may beelectrically coupled to the selected bit line via column decoder 504.Transistor 562 couples (or electrically connects) node SELB to theVsense node. The transistor 562 may comprise a low VT nMOS device. Clampcontrol circuit 564 controls the gate of transistor 562. The Vsense nodeis connected to reference current Iref and one input of sense amplifier566. The other input of sense amplifier 566 receives Vref-read, which isthe voltage level used for comparing the Vsense node voltage in readmode. The output of sense amplifier 566 is connected to the data outterminal and to data latch 568. Write circuit 560 is connected to nodeSELB, the Data In terminal, and data latch 568.

In one embodiment, during a read operation, read/write circuit 502biases the selected bit line to the selected bit line voltage in readmode. Prior to sensing data, read/write circuit 502 will precharge theVsense node to 2V (or some other voltage greater than the selected bitline voltage). When sensing data, read/write circuit 502 attempts toregulate the SELB node to the selected bit line voltage (e.g., 1V) viaclamp control circuit 564 and transistor 562 in a source-followerconfiguration. If the current through the selected memory cell 550 isgreater than the read current limit, Iref, then, over time, the Vsensenode will fall below Vref-read (e.g., set to 1.5V) and the senseamplifier 566 will read out a data “0.” Outputting a data “0” representsthat the selected memory cell 550 is in a low resistance state (e.g., aSET state). If the current through the selected memory cell 550 is lessthan Iref, then the Vsense node will stay above Vref-read and the senseamplifier 566 will read out a data “1.” Outputting a data “1” representsthat the selected memory cell 550 is in a high resistance state (e.g., aRESET state). Data latch 568 may latch the output of sense amplifier 566after a time period of sensing the current through the selected memorycell (e.g., after 400 n 5). In some cases, data read from a read/writecircuit, such as read/write circuit 502 may contain a bit error.

In one embodiment, during a write operation, if the Data In terminalrequests a data “0” to be written to a selected memory cell, thenread/write circuit 502 may bias SELB to the selected bit line voltagefor programming a data “0” in write mode (e.g., 1.2V for a SEToperation) via write circuit 560. The duration of programming the memorycell may be a fixed time period (e.g., using a fixed-width programmingpulse) or variable (e.g., using a write circuit 560 that senses whethera memory cell has been programmed while programming). If the Data Interminal requests a data “1” to be written, then read/write circuit 502may bias SELB to the selected bit line voltage for programming a data“1” in write mode (e.g., 0V or −1.2V for a RESET operation) via writecircuit 560. In some cases, if a selected memory cell is to maintain itscurrent state, then the write circuit 560 may bias SELB to a programinhibit voltage during write mode. The program inhibit voltage may bethe same as or close to the unselected bit line voltage.

FIG. 6A depicts one embodiment of a Tanner graph with variable nodes602-604, check nodes 612-614, and edges including edges 622-625. Asdepicted, variable node 602 has edges to check nodes 612-613, variablenode 603 has edges to check nodes 612-614, and variable node 604 hasedges to check nodes 613-614. Although three variable nodes and threecheck nodes are depicted in FIG. 6A, other Tanner graphs may includeadditional variable nodes and check nodes. In these cases, the number ofvariable nodes, for example, may comprise 128 nodes or 256 nodes. Insome cases, the check node 613 may correspond with one of theparity-check equations for the variable nodes 602-604. As there are nodirect edges between the variable nodes, the local decoding operationsmay be performed independently and in parallel.

FIG. 6B depicts one embodiment of the variable node 603 in FIG. 6A withinput channel message 626, input messages 623-624 from check nodes612-613, and an output message 625 to check node 614. The channelmessage 626 may correspond with data read from a semiconductor memory orwith a data probability for the data read from the semiconductor memorythat the data comprises a particular data state. In the case that athree-bit per cell memory was read, the channel message 626 may comprisedata identifying which data state out of the eight possible data stateswas sensed or eight input channel probabilities for each of the eightpossible data states. As depicted, the output message 625 is generatedusing the input channel message 626 and input messages 623-624. Theincoming message from check node 614 is not considered when updating orgenerating the output message 625 to the check node 614.

FIG. 6C depicts one embodiment of three variable nodes VN₀, VN₁, and VN₂of a Tanner graph and incoming messages that may be processed anddecoded by the variable nodes. Each of the three variable nodes maycorrespond with one bit or one symbol of an input codeword. The inputcodeword may have been read from a semiconductor memory or received froman off-chip data transfer to the semiconductor memory. The incomingmessages may comprise log-likelihood ratios or L-values that weregenerated using a log-likelihood equation, such as equation 651 in whichi is associated with a variable node and j is associated with a checknode. The L-values associated with incoming messages L₀₀, L₀₁, and L₀₂to variable node VN₀ may correspond with outgoing messages from threedifferent check nodes not depicted. In one example, the L-value L₀₀ maycorrespond with a first edge from the variable node VN₀ to a first checknode CN₀, the L-value L₀₁ may correspond with a second edge from thevariable node VN₀ to a second check node CN₁, and the L-value L₀₂ maycorrespond with a third edge from the variable node VN₀ to a third checknode CN₂. For the three variable nodes depicted, there are threeincoming channel messages L₀, L₁, and L₂ corresponding with threedifferent bit values or symbol values within the input codeword and nineincoming messages from check nodes within the Tanner graph.

FIG. 6D depicts the three variable nodes of FIG. 6C in which outputmessages L₀₀, L₁₁, and L₂₂ have been generated and outputted. The outputmessage L₀₀ may be generated as the sum of L₀₁, L₀₂, and L₀. The outputmessage L₁₁ may be generated as the sum of L₁₀, and L₁. The outputmessage L₂₂ may be generated as the sum of L₂₀, L₂₁, and L₂. Whengenerating a particular output message at a variable node, the incomingmessage for the corresponding edge may not be taken into consideration.

FIG. 6E depicts one embodiment of a multi-variable node VNs 652 that isassociated with multiple variable nodes VN₀, VN₁, and VN₂. Themulti-variable node VNs 652 may correspond with the grouping of or theconsolidation of variable nodes VN₀, VN₁, and VN₂. As depicted, themulti-variable node VNs 652 takes as input the eight input channelprobabilities Pch(000) through Pch(111) for the eight data statescorresponding with three data bits. The generated L-value L₀₀ 654 isequal to the log of P(0) 655 divided by P(1) 656. P(0) 655 isproportional to or equal to the sum of Pch(000)e^(L0+L1+L2),Pch(001)e^(L0+L1), Pch(010)e^(L0+L2), and Pch(011)e^(L0). P(1) 656 isproportional to or equal to the sum of Pch(100)e^(L1+L2),Pch(101)e^(L1), Pch(110) e^(L2), and Pch(111). In this case, L₀ is equalto the sum of L₀₁ and L₀₂; L₁ is equal to the sum of L₁₀, L₁₁, and L₁₂;and L₂ is equal to the sum of L₂₀, L₂₁, and L₂₂. Thus, the outputmessage for the generated L-value L₀₀ 654 takes into account all eightof the input channel probabilities Pch(000) through Pch(111).

FIG. 6F depicts one embodiment of the multi-variable node VNs 652 thatis associated with multiple variable nodes VN₀, VN₁, and VN₂. Themulti-variable node VNs 652 takes as input the input channelprobabilities Pch(000) through Pch(111) for the eight data statescorresponding with three data bits. As depicted, the generated L-valueL₁₀ 674 is equal to the log of P(0) 675 divided by P(1) 676. P(0) 675 isproportional to or equal to the sum of Pch(000)e^(L0+L1+L2),Pch(001)e^(L0+L1), Pch(100)e^(L1+L2), and Pch(101)e^(L1). P(1) 676 isproportional to or equal to the sum of Pch(010)e^(L0+L2),Pch(011)e^(L0), Pch(110)e^(L2), and Pch(111). In this case, L₀ is equalto the sum of L₀₀, L₀₁, and L₀₂; L₁ is equal to the sum of L₁₁ and L₁₂;and L₂ is equal to the sum of L₂₀, L₂₁, and L₂₂. Thus, the outputmessage for the generated L-value L₁₀ 674 takes into account all eightof the input channel probabilities Pch(000) through Pch(111).

FIG. 6G depicts one embodiment of the multi-variable node VNs 652 thatis associated with multiple variable nodes VN₀, VN₁, and VN₂. Themulti-variable node VNs 652 takes as input the input channelprobabilities Pch(000) through Pch(111) for the eight data statescorresponding with three data bits. As depicted, the generated L-valueL₂₀ 684 is equal to the log of P(0) 685 divided by P(1) 686. P(0) 685 isproportional to or equal to the sum of Pch(000)e^(L0+L1+L2),Pch(010)e^(L0+L2), Pch(100)e^(L1+L2), and Pch(110)e^(L2). P(1) 686 isproportional to or equal to the sum of Pch(001)e^(L0+L1),Pch(011)e^(L0), Pch(101)e^(L1), and Pch(111). In this case, L₀ is equalto the sum of L₀₀, L₀₁, and L₀₂; L₁ is equal to the sum of L₁₀, L₁₁, andL₁₂; and L₂ is equal to the sum of L₂₁ and L₂₂. Thus, the output messagefor the generated L-value L₂₀ 684 takes into account all eight of theinput channel probabilities Pch(000) through Pch(111).

FIG. 7A is a flowchart describing one embodiment of a process forcorrecting data errors. In one embodiment, the process of FIG. 7A may beperformed by a memory chip controller or a controller in communicationwith a plurality of memory banks, such as controller 102 in FIG. 1 . Theprocess of FIG. 7A may also be performed by LDPC decoding circuitryintegrated with a semiconductor memory.

In step 702, a set of data state probabilities for a set of data storedusing a set of memory cells is determined. The set of memory cells maybe part of a semiconductor memory. The set of memory cells may compriseNAND Flash memory cells and the set of data state probabilities may bedetermined based on the sensed threshold voltages or the locations ofthe sensed threshold voltages within the threshold voltage windows. Thesensed threshold voltages may be sensed using a sensing circuit or aread/write circuit, such as the read/write circuit 502 in FIG. 5B. Inone example, if the threshold voltage window for the B-state is between1.0V and 1.6V, then if the sensed threshold voltage is between 1.2V and1.4V, then the data state probability may be set to 0.9 or 1.0; however,if the sensed threshold voltage is between 1.0V and 1.2V or between 1.4Vand 1.6V, then the data state probability may be set to 0.45 or 0.5.Thus, the set of data state probabilities may depend on the sensedthreshold voltages for the set of memory cells and/or the location ofthe sensed threshold voltages relative to the ends of theircorresponding threshold voltage windows. In some cases, a thresholdvoltage window for a particular data state (e.g., the B-state) mayinclude an edge region that is within a particular distance (e.g.,within 50 mV) of an edge of the threshold voltage window. In someembodiments, a data state probability look-up table may be used to mapthe sensed threshold voltages to the set of data state probabilities. Inone example, if a sensed threshold voltage is equal to 1.1V, then theoutputted data state probability may comprise 0.45; however, if thesensed threshold voltage is equal to 1.3V, then the outputted data stateprobability may comprise 1.0.

In step 704, a multi-variable node that corresponds with a plurality ofvariable nodes within a Tanner graph is generated. In one example, themulti-variable node may correspond with the multi-variable node VNs 652in FIGS. 6E-6G. In step 706, a first set of outgoing messages for themulti-variable node is generated using the set of data stateprobabilities determined in step 702. The first set of outgoing messagesmay include a first outgoing message corresponding with the generatedL-value L₂₀ 684 in FIG. 6G, a second outgoing message corresponding withthe generated L-value L₁₀ 674 in FIG. 6F, and a third outgoing messagecorresponding with the generated L-value L₀₀ 654 in FIG. 6E.

In step 708, the first set of outgoing messages is transferred to aplurality of check nodes. In step 710, it is detected that a validcodeword has not been found. In step 711, a second set of incomingmessages is acquired from the plurality of check nodes. In step 712, asecond set of outgoing messages for the multi-variable node is generatedusing the set of data state probabilities and the second set of incomingmessages acquired in step 711. In step 714, the second set of outgoingmessages is transferred to the plurality of check nodes. An iterativemessage passing algorithm may be used in which messages are passedthrough the edges of the Tanner graph between the plurality of checknodes and a plurality of multi-variable nodes including themulti-variable node until either a valid codeword is identified or aniteration limit is reached (e.g., more than twelve iterations have beenperformed). The message passing algorithm may comprise a sum-productdecoding algorithm or a max-product decoding algorithm. The validcodeword may correspond with a valid set of data and parity bits thatmay be stored within a memory array of a semiconductor memory. In step716, it is detected that a valid codeword has been found. In some cases,it may be detected that the valid codeword has been found if no biterrors are detected for the valid codeword. The valid codeword may bedetected if each of the parity check equations associated with theplurality of check nodes for the Tanner graph are satisfied. In step718, the valid codeword is outputted. In one example, the valid codewordmay be stored using a semiconductor memory or transferred from thesemiconductor memory to another integrated circuit.

FIG. 7B is a flowchart describing another embodiment of a process forcorrecting data errors. In one embodiment, the process of FIG. 7B may beperformed by a memory chip controller or a controller in communicationwith a plurality of memory banks, such as controller 102 in FIG. 1 . Theprocess of FIG. 7B may also be performed by LDPC decoding circuitry incommunication with a semiconductor memory.

In step 742, a set of stored threshold voltages for a set of memorycells is determined. The set of memory cells may comprise NAND Flashmemory cells. The set of stored threshold voltages may be determinedusing sensing circuitry or read/write circuitry, such as read/writecircuitry 502 in FIG. 5B. In step 744, a set of data state probabilitiesfor the set of memory cells is determined using the set of storedthreshold voltages. In one example, the set of data state probabilitiesfor the set of memory cells may be determined using a look-up table thatmaps sensed or stored threshold voltages to corresponding data statesand probabilities for those data states. In some cases, the look-uptable may map sensed or stored threshold voltages to data stateprobabilities for each of the possible data states for the set of memorycells (e.g., eight probabilities may be outputted for athree-bits-per-cell memory).

In some embodiments, a first memory cell of the set of memory cells maybe sensed or read in order to determine whether the stored thresholdvoltage for the first memory cell is within one of a plurality ofthreshold voltage windows. The number of threshold voltage windows maybe greater than the number of possible data states for the first memorycell. In some cases, a data state (e.g., the B-state) may be associatedwith three threshold voltage windows; the three windows may comprise amiddle window with a high data state probability and two side windowswith lower data state probabilities than the high data stateprobability. In one example, the middle window may cover a range ofthreshold voltages between 1.2V and 1.4V and correspond with a datastate probability of 0.9; a first side window may cover thresholdvoltages between 1.0V and 1.2V and correspond with a data stateprobability of 0.45; and a second side window may cover thresholdvoltages between 1.4V and 1.6V and correspond with a data stateprobability of 0.45. In some embodiments, not every data state may beoversampled. For example, for a two-bits-per-cell memory cell, only theB and C data states may be oversampled.

In step 746, it is detected that the set of memory cells comprisesmulti-level memory cells. In step 748, a plurality of multi-variablenodes for a Tanner graph is generated in response to detection that theset of memory cells comprises multi-level memory cells. The plurality ofmulti-variable nodes includes a first multi-variable node. The firstmulti-variable node is connected to a plurality of check nodes of theTanner graph. In one example, if it is detected that the set of memorycells comprise two-bits-per-cell memory cells, then the firstmulti-variable node may be formed by grouping two variable nodes. Inanother example, if it is detected that the set of memory cells comprisethree-bits-per-cell memory cells, then the first multi-variable node maybe formed by grouping three variable nodes.

In some embodiments, the Tanner graph may include a secondmulti-variable node corresponding with two variable nodes and a thirdmulti-variable node corresponding with three variable nodes. In thiscase, the codeword may span both two-bits-per-cell andthree-bits-per-cell memory cells at the same time. In other embodiments,the set of memory cells may store two-bits-per-cell at a first point intime and a first Tanner graph may include multi-variable nodescorresponding with two-bits-per-cell at the first point in time; thensubsequently, the set of memory cells may store three-bits-per-cell at asecond point in time and a second Tanner graph may includemulti-variable nodes corresponding with three-bits-per-cell at thesecond point in time.

In step 750, a second set of incoming messages is acquired from theplurality of check nodes. The second set of incoming messages maycorrespond with L₀₁, L₀₂, L₂₀, L₂₁, L₂₂, L₁₀, L₁₁, and L₁₂ in FIG. 6E.In step 752, a first outgoing message of a set of outgoing messages isgenerated using a first subset of the second set of incoming messages.The first outgoing message may correspond with L₀₀ 654 in FIG. 6E. Instep 754, a second outgoing message of the set of outgoing messages isgenerated using a second subset of the second set of incoming messages.The second outgoing message may correspond with L₁₀ 674 in FIG. 6F. Thefirst subset of the second set of incoming messages may be differentfrom the second subset of the second set of incoming messages. In step756, the set of outgoing messages is transferred to the plurality ofcheck nodes.

An iterative message passing algorithm may be used in which messages arepassed through the edges of the Tanner graph between the plurality ofcheck nodes and the plurality of multi-variable nodes including thefirst multi-variable node until either a valid codeword is identified oran iteration limit is reached. The message passing algorithm maycomprise the modified sum-product decoding algorithm. The valid codewordmay correspond with a valid set of data and parity bits that may bestored within a memory array of a semiconductor memory. In step 758, itis detected that a valid codeword has been found. In some cases, it maybe detected that the valid codeword has been found if no bit errors aredetected for the valid codeword or if each of the parity check equationsassociated with the plurality of check nodes for the Tanner graph aresatisfied. The valid codeword may be stored using a semiconductor memoryor transferred from the semiconductor memory to another integratedcircuit.

One embodiment of the disclosed technology includes a semiconductormemory including a set of memory cells and one or more control circuits.The one or more control circuits configured to determine a set of sensedthreshold voltages for the set of memory cells and determine a set ofdata state probabilities for the set of memory cells based on the set ofsensed threshold voltages. The one or more control circuits configuredto identify a multi-variable node that corresponds with a plurality ofvariable nodes of a bipartite graph. The bipartite graph includes theplurality of variable nodes and a plurality of check nodes. The one ormore control circuits configured to generate a first set of outgoingmessages for the multi-variable node using the set of data stateprobabilities and transfer the first set of outgoing messages to theplurality of check nodes. The one or more control circuits configured todetect that a valid codeword has been found based on a second set ofincoming messages from the plurality of check nodes and store the validcodeword using the semiconductor memory in response to detection thatthe valid codeword has been found.

One embodiment of the disclosed technology includes determining a set ofsensed threshold voltages for a set of memory cells of the semiconductormemory, determining a set of data state probabilities for the set ofmemory cells using the set of sensed threshold voltages, and identifyinga multi-variable node that corresponds with a plurality of variablenodes of a bipartite graph. The bipartite graph includes the pluralityof variable nodes and a plurality of check nodes. The method furthercomprises generating a first set of outgoing messages for themulti-variable node using the set of data state probabilities. The firstset of outgoing messages comprises at least two different outgoingmessages. The method further comprises transferring the first set ofoutgoing messages to the plurality of check nodes, detecting that avalid codeword has been found subsequent to transferring the first setof outgoing messages to the plurality of check nodes, and storing thevalid codeword using the semiconductor memory in response to detectingthat the valid codeword has been found.

One embodiment of the disclosed technology includes a set of memorycells and one or more control circuits. Each memory cell of the set ofmemory cells comprises a multi-level memory cell. The one or morecontrol circuits configured to determine a set of stored thresholdvoltages for the set of memory cells and identify a set of data stateprobabilities for the set of stored threshold voltages. The one or morecontrol circuits configured to generate a multi-variable node thatcorresponds with a plurality of variable nodes of a bipartite graph. Thebipartite graph includes the plurality of variable nodes and a pluralityof check nodes. The one or more control circuits configured to determinea number of data states per memory cell for the set of memory cells andgenerate the multi-variable node based on the number of data states permemory cell for the set of memory cells. The one or more controlcircuits configured to generate a first set of outgoing messages for themulti-variable node based on the set of data state probabilities andtransfer the first set of outgoing messages to the plurality of checknodes. The one or more control circuits configured to detect that avalid codeword has been found based on a second set of incoming messagesfrom the plurality of check nodes and store the valid codeword inresponse to detection that the valid codeword has been found.

In some cases, the one or more control circuits may be configured togenerate a first message of the first set of outgoing messages usingdata state probabilities for each data state of the number of datastates per memory cell for the set of memory cells. For example, if thenumber of data states per memory cell for the set of memory cellscomprises three-bits-per-cell, then the first message may be generatedusing probabilities for each of the eight possible data states. Theprobabilities for each of the eight possible data states may correspondwith the eight input channel probabilities Pch(000) through Pch(111)depicted in FIG. 6E.

For purposes of this document, a first layer may be over or above asecond layer if zero, one, or more intervening layers are between thefirst layer and the second layer.

For purposes of this document, it should be noted that the dimensions ofthe various features depicted in the figures may not necessarily bedrawn to scale.

For purposes of this document, reference in the specification to “anembodiment,” “one embodiment,” “some embodiments,” or “anotherembodiment” may be used to describe different embodiments and do notnecessarily refer to the same embodiment.

For purposes of this document, a connection may be a direct connectionor an indirect connection (e.g., via another part). In some cases, whenan element is referred to as being connected or coupled to anotherelement, the element may be directly connected to the other element orindirectly connected to the other element via intervening elements. Whenan element is referred to as being directly connected to anotherelement, then there are no intervening elements between the element andthe other element.

For purposes of this document, the term “based on” may be read as “basedat least in part on.”

For purposes of this document, without additional context, use ofnumerical terms such as a “first” object, a “second” object, and a“third” object may not imply an ordering of objects, but may instead beused for identification purposes to identify different objects.

For purposes of this document, the term “set” of objects may refer to a“set” of one or more of the objects.

Although the subject matter has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the subject matter defined in the appended claims is notnecessarily limited to the specific features or acts described above.Rather, the specific features and acts described above are disclosed asexample forms of implementing the claims.

What is claimed is:
 1. An apparatus, comprising: a buffer; and one ormore control circuits in communication with the buffer, the one or morecontrol circuits configured to acquire a set of input channelprobabilities, each input channel probability associated with acorresponding data state for a set of multi-level memory cells, thenumber of input channel probabilities per multi-level memory cell in theset is equal to the number of data states per multi-level memory cell,and generate a graph that includes a multi-variable node with edges to aplurality of check nodes, the one or more control circuits configured togenerate a set of outgoing messages for the multi-variable node usingall input channel probabilities of the set of input channelprobabilities and transfer the set of outgoing messages from themulti-variable node to the plurality of check nodes, the one or morecontrol circuits configured to generate log-likelihood ratios for theplurality of check nodes and detect that a valid codeword correspondingwith the threshold voltages for the set of multi-level memory cells hasbeen identified based on the log-likelihood ratios for the plurality ofcheck nodes, the one or more control circuits configured to write thevalid codeword to the buffer in response to detection that the validcodeword has been identified.
 2. The apparatus of claim 1, wherein: theone or more control circuits configured to detect that a first thresholdvoltage of the threshold voltages for the set of multi-level memorycells is within an edge region of a threshold voltage window anddetermine at least a first subset of the set of input channelprobabilities in response to detection that the first threshold voltageis within the edge region of the threshold voltage window.
 3. Theapparatus of claim 1, wherein: the set of input channel probabilitiescomprises eight or more input channel probabilities.
 4. The apparatus ofclaim 1, wherein: the set of input channel probabilities comprises eightinput channel probabilities for eight possible data states correspondingwith three data bits per multi-level memory cell.
 5. The apparatus ofclaim 1, wherein: the one or more control circuits configured togenerate the multi-variable node based on a number of data states permemory cell for the set of multi-level memory cells.
 6. The apparatus ofclaim 5, wherein: the one or more control circuits configured togenerate a first message of the set of outgoing messages using datastate probabilities for each data state of the number of data states permemory cell for the set of multi-level memory cells.
 7. The apparatus ofclaim 1, wherein: the set of multi-level memory cells comprises aplurality of floating gate transistors.
 8. The apparatus of claim 1,wherein: the buffer comprises a memory buffer arranged on a first die;and the set of multi-level memory cells is arranged on a second die. 9.The apparatus of claim 1, wherein: the buffer is arranged on a firstintegrated circuit; the one or more control circuits are arranged on thefirst integrated circuit; and the set of multi-level memory cells isarranged on a second integrated circuit.
 10. The apparatus of claim 1,wherein: the set of multi-level memory cells comprises vertical NANDstrings.
 11. A method, comprising: determining a set of thresholdvoltages corresponding with data stored using a set of memory cells, thedata stored by programming memory cells to a predetermined number ofdata states; determining a set of input channel probabilities based onthe set of threshold voltages, the number of input channel probabilitiesper memory cell in the set being equal to the predetermined number ofdata states, each input channel probability of the set corresponding toa respective data state; generating a bipartite graph that includes amulti-variable node with edges to a plurality of check nodes; generatingat least two outgoing messages for the multi-variable node using allinput channel probabilities of the set of input channel probabilities;transferring the at least two outgoing messages from the multi-variablenode to the plurality of check nodes; acquiring log-likelihood ratiosfor the plurality of check nodes subsequent to transferring the at leasttwo outgoing messages from the multi-variable node to the plurality ofcheck nodes; detecting that a valid codeword for the data stored usingthe set of memory cells has been identified based on the log-likelihoodratios for the plurality of check nodes; and storing the valid codewordin a memory buffer in response to detection that the valid codeword hasbeen identified.
 12. The method of claim 11, wherein: the determiningthe set of input channel probabilities includes detecting that a firstthreshold voltage of the set of threshold voltages for a first memorycell of the set of memory cells is associated with one of a plurality ofthreshold voltage windows for a particular data state.
 13. The method ofclaim 11, wherein: the determining the set of input channelprobabilities includes detecting that a first threshold voltage of theset of threshold voltages for a first memory cell of the set of memorycells is within an edge region of a threshold voltage window.
 14. Themethod of claim 11, wherein: the set of input channel probabilities forthe set of memory cells consists of eight data state probabilitiescorresponding with eight possible data states for a first memory cell ofthe set of memory cells.
 15. The method of claim 11, further comprising:acquiring a mapping table and determining the set of input channelprobabilities using the mapping table and the set of threshold voltages.16. The method of claim 11, further comprising: determining a number ofdata states stored per memory cell for the set of memory cells andgenerating the multi-variable node based on the number of data statesstored per memory cell for the set of memory cells.
 17. The method ofclaim 16, wherein: the generating the at least two outgoing messages forthe multi-variable node includes generating a first message using datastate probabilities for each data state of the number of data statesstored per memory cell for the set of memory cells.
 18. The method ofclaim 11, wherein: the memory buffer is arranged on a first die; and theset of memory cells is arranged on a second die.
 19. The method of claim18, wherein: the set of memory cells comprises memory cells arrangedwithin vertical strings.
 20. An apparatus, comprising: a memory buffer;and one or more control circuits configured to determine a set of storedthreshold voltages associated with a set of multi-level memory cells andidentify a set of data state probabilities for the set of storedthreshold voltages, the number of data state probabilities permulti-level memory cell in the set is equal to the number of data statesper multi-level memory cell, the one or more control circuits configuredto generate a multi-variable node that corresponds with a plurality ofvariable nodes of a bipartite graph, the bipartite graph includes theplurality of variable nodes and a plurality of check nodes, the one ormore control circuits configured to generate the multi-variable nodebased on a number of data states per multi-level memory cell for the setof multi-level memory cells, the one or more control circuits configuredto generate a first set of outgoing messages for the multi-variable nodebased on the set of data state probabilities and transfer the first setof outgoing messages to the plurality of check nodes, the one or morecontrol circuits configured to generate a first message of the first setof outgoing messages using data state probabilities for each data stateof the number of data states per multi-level memory cell for the set ofmulti-level memory cells, the one or more control circuits configured todetect that a valid codeword has been identified based on a second setof incoming messages from the plurality of check nodes and store thevalid codeword using the memory buffer in response to detection that thevalid codeword has been identified.